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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION, 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )M Responsive to communication(s) filed on 15 August 2001 . 
2a)n This action is FINAL. 2b)|EI This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice.under Ex parte. Q^^ _ 
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4) ^ Claim(s) 1 to 10 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) M Claim{s)lio_/0 is/are rejected. 

Claim{s) is/are objected to. 

8) n Claim{s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

10)n The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 



Specification 

1 . The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 

The following title is suggested: 

P hone me As signment for Multi-Ling ual Speech Recognition 

2. TheriisclosTrre is objected to because oft 

The Specification does not contain section headings according to conventional 
patent practice in the United States. It is suggested that section headings be added for 
Background of the Invention, Summary of the Invention, Brief Description of the 
Drawings, and Detailed Description of the Preferred Embodiments. 

On page 4. lines 6 to 7, reference should be deleted to claim 1 . Claimed subject 
matter of an issued patent may not reflect originally filed claim 1 . 

Appropriate correction is required. 



Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more clainns particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claim 3 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 
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The claim contains a parenthetical "(SAMPA)", which renders it indefinite. The 
scope of the claim is not well defined because it is unclear whether "SAMPA" is to be 
considered a positive limitation of the claim, as a specific form of phonetic transcription, 
or whether "SAMPA" is only to be considered an example of one of many possible 
forms of phonetic transcription. If "SAMPA" is a positive limitation of the claim, then, for 
purposes of clarity, the acronym should be written in a non-abbreviated form. 

Claim Rejections^35 use §103 

5. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 1 to 5 and 7 to 8 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kohler ("Multi-lingual phoneme recognition exploiting acoustic- 
phonetic similarities of sound") in view of Barry et ai ("The simultaneous use of three 
machine speech recognition systems to increase recognition accuracy"). 

Concerning independent claim 1, KoWer discloses a method of assigning 
phonemes for multi-lingual phoneme modeling in speech recognition, where a distance 
measure determines a similarity for substitution of phonemes from a source language 
into a target language. (Sections 3.5 and 4.2: Pages 2196 to 2197) Ko/?/er suggests 
language-dependent phoneme assignment by a plurality of methods, including 
automatically aligning labels and hand labeled transcriptions (Section 4.1: Page 2197), 
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but omits two or more different phoneme assigning methods, where a phoneme is 
detected and selected by a majority of the different speech data assigning methods if a 
majority have a matching assignment, but a phoneme is selected by at least one of the 
different phoneme assigning methods in accordance with a similarity parameter. 
However, utilizing two or more different phoneme assigning methods, and then 
selecting if a majority have a matching assignment is equivalent to a majority rules 
algorithm. Barry et aL teaches an analogous art method wit h an E nhanced Majority 
Ru les (EM R) software algorith m for speech recog n ition, where three speech recog n ition" 
systems increase recognition accuracy. Recognition data is collected from each of 
three systems and if multiple responses are returned, or if two or more systems agree, 
and there is a clear majority, then the chosen word is reported. If there is no clear 
majority, then a word with a lowest average distance score is chosen. (Pages 668 to 
669: Figure 2) It would have been obvious to one having ordinary skill in the art to apply 
a majority rules algorithm as taught by Barry et aL to a multi-lingual phoneme 
assignment method of Kohlerfor the purpose of increasing recognition accuracy. 

Concerning claim 2, Ko/?/er discloses multi-lingual phonenne substitution for a 
plurality of source languages, e.g. English, German, and Spanish (Abstract; Sections 
3.1 and 4.2: Tables 1 and 2). 

Concerning claim 3, Ko/?/er discloses clustering or substitution of phoneme 
models by a distance or similarity measure (Section 3.5: Page 21 96) for international 
phonetic transcriptions including SAMPA (Section 3.2: Page 2196). 
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Concerning claim 4, Ko/?/er discloses cross-language phoneme model 
substitution by a distance metric, where phonemes are substituted that have the 
smallest distance or highest similarity to each other (Section 4.2: Page 2197). 

Concerning claim 5, Ko/7/er discloses cross-language phoneme model 
substitution for speech recognition to obtain a highest phoneme recognition rate 
(Sections 4.1 to 4.3: Tables 2 to 4: Pages 2197 to 2198). 

Concerning claim^ 7 andJB, Ko/7/er disclo ses cro ss-language phoneme model 
^bstitution, which"i^irnplicitly a program stored and executed on a computer. 

7, Claims 6, 9, and 1 0 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Kohler ("Multi-lingual phoneme recognition exploiting acoustic-phonetic similarities 
of sound") in view of Barry et ai ("The simultaneous use of three machine speech 
recognition systems to increase recognition accuracy") as applied to claim 1 above, and 
further in view of Kohler ("Language adaptation of multilingual phone models for 
vocabulary independent speech recognition tasks"). 

Concerning claim 6, Kohler ("Multi-lingual phoneme recognition exploiting 
acoustic-phonetic similarities of sound") suggests cross-language phoneme model 
substitution for automatic speech recognition, where phoneme models are trained by a 
standard viterbi-based maximum likelihood training algorithm (Section 4: Page 2196), 
but does not expressly disclose adapting an assigned basic phoneme unit to the target 
language after assignment from a source language. However, Kohler ("Language 
adaptation of multilingual phone models for vocabulary independent speech recognition 
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tasks") teaches language adaptation of multilingual phone models, where a phone 
model is adapted to a new target language by MAP-Adaptation (Section 3.2: Map- 
Adaptation (MAP): Page 419). The objective is to reduce the amount of training data for 
cross language transfer, thereby reducing time and expense. (Section 1. Introduction: 
Page 417) It would have been obvious to one having ordinary skill in the art to adapt 
phoneme models to a target language after cross-language phoneme substitution from 
a source language asteught by Ko/?/erf 'language ada ptati on of multilingual phone 
lmdels~f6rvoca^lafy^inde^ 

language phoneme model substitution oi Kohler CMulti-lingual phoneme recognition 
exploiting acoustic-phonetic similarities of sound") for the purpose of reducing time, 
expense, and amount of training data. 

Concerning claims 9 and 10, Kohler ("Multi-lingual phoneme recognition 
exploiting acoustic-phonetic similarities of sound") discloses phoneme models for 
speech recognition. 

Conclusion 

8. The prior art made of record and not relied upon is considered pertinent to 
Applicant's disclosure. 

Bub et al., Kohler ('500), and Fabiani et al. disclose related art. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Martin Lerner whose telephone number is (703) 308- 
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9064. The examiner can normally be reached on 8:30 AM to 6:00 PM Monday to 
Thursday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (703) 305-9645. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 



Inform ation regarding the status of an a p plication may be obtained from the 
PatentA^licatiorrlnforrTrationRetriev^^^ 

published applications may be obtained from either Private PAIR or Public PAIR, 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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